Oracle-efficient Nonparametric Estimation of an Additive Model with an Unknown Link Function
نویسنده
چکیده
This paper describes an estimator of the additive components of a nonparametric additive model with an unknown link function. When the additive components and link function are twice differentiable with sufficiently smooth second derivatives, the estimator is asymptotically normally distributed with a rate of convergence in probability of . This is true regardless of the (finite) dimension of the explanatory variable. Thus, the estimator has no curse of dimensionality. Moreover, the asymptotic distribution of the estimator of each additive component is the same as it would be if the link function and the other components were known with certainty. Thus, asymptotically there is no penalty for not knowing the link function or the other components. 2 / 5 n−
منابع مشابه
Rate-optimal Estimation for a General Class of Nonparametric Regression Models with Unknown Link Functions
This paper discusses a nonparametric regression model that naturally generalizes neural network models. The model is based on a finite number of one-dimensional transformations and can be estimated with a one-dimensional rate of convergence. The model contains the generalized additive model with unknown link function as a special case. For this case, it is shown that the additive components and...
متن کاملNonparametric Estimation of a Generalized Additive Model with an Unknown Link Function
This paper is concerned with estimating the mean of a random variable Y conditional on a vector of covariates X under weak assumptions about the form of the conditional mean function. Fully nonparametric estimation is usually unattractive when X is multidimensional because estimation precision decreases rapidly as the dimension of X increases. This problem can be overcome by using dimension red...
متن کاملEfficient Estimation in Panel Data Partially Additive Linear Model with Serially Correlated Errors
The partially linear additive model arises in many scientific endeavors. In this paper, we look at inference given panel data and a serially correlated error component structure. By combining polynomial spline series approximation with least squares and the estimation of correlation, we propose a weighted semiparametric least squares estimator (WSLSE) for the parametric components, and a weight...
متن کاملNonparametric Estimation of an Additive Quantile Regression Model
This paper is concerned with estimating the additive components of a nonparametric additive quantile regression model. We develop an estimator that is asymptotically normally distributed with a rate of convergence in probability of n−r/(2r+1) when the additive components are r-times continuously differentiable for some r ≥ 2. This result holds regardless of the dimension of the covariates and, ...
متن کاملDetecting Nonlinear Causality in Multivariate Time Series with Sparse Additive Models
We propose a nonparametric method for detecting nonlinear causal relationship within a set of multidimensional discrete time series, by using sparse additive models (SpAMs). We show that, when the input to the SpAM is a β-mixing time series, the model can be fitted by first approximating each unknown function with a linear combination of a set of B-spline bases, and then solving a group-lasso-t...
متن کامل